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ABSTRACT 

A  theory  of  interval  iteration,  based  on  a  few  simple  assumptions,  is 
given  for  the  fixed  point  problem  for  operators  in  partially  ordered 
topological  spaces*  A  comparison  of  interval  with  ordinary  iteration  is  made 
which  shows  that  their  properties  are  converse  in  a  certain  sense  with  respect 
to  existence  or  nonexistence  of  fixed  points*  The  theory  of  interval 
Iteration  is  shown  to  hold  without  modification  if  the  computation  is 
restricted  to  a  finite  set  of  points,  as  in  actual  practice*  In  this  latter 
case,  interval  iteration  is  shown  to  converge  or  diverge  in  a  finite  number  of 
steps,  for  which  an  upper  bound  is  given.  By  the  introduction  of  a  suitable 
iteration  operator,  the  method  of  Interval  iteration  is  extended  to  the 
problem  of  solution  of  equations  in  linear  spacers. 
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SIGNIFICANCE  AND  EXPLANATION 

Interval  iteration  is  a  powerful  computational  method  with  applications 
to  the  solution  of  linear  and  nonlinear  systems  of  equations,  integral 
equations  (see  MRC  TSR  #2128),  and  differential  equaitons.  Because  of  this 
diversity,  it  is  helpful  to  have  a  general  theory  to  act  as  a  guide  to 
specific  applications.  This  report  gives  such  a  general  theory,  based  on  only 
a  few  simple  assumptions  to  give  it  as  wide  a  scope  as  possible.  The  notions 
of  convergence  and  divergence  of  interval  iteration  are  defined  and  their 
Implications  with  regard  to  existence  or  nonexistence  of  solutions  are 
presented.  It  turns  out  that  convergence  of  interval  iteration  is  assured  if 
the  initial  interval  contains  a  solution,  and  the  iteration  in  this  case  can 
provide  improved  lower  and  upper  bounds  for  the  solution.  Divergence  of 
interval  iteration,  on  the  other  hand,  shows  that  the  initial  interval  did  not 
contain  a  solution,  and  thus  may  be  discarded.  These  properties  are  compared 
with  the  well-known  results  for  ordinary  iteration,  and  shown  to  be  converse 
in  a  certain  sense.  Remarks  on  how  to  use  interval  iteration  in  applications 
are  made,  and  the  tneory  is  also  shown  to  hold  if  the  computation  is 
restricted  to  a  finite  set  of  elements,  as  on  an  ordinary  computer. 
Construction  of  interval  extensions  which  are  exactly  representable  in  the 
finite  case  is  explained,  and  it  is  observed  that  interval  iteration  will 
converge  or  diverge  in  a  finite  number  of  steps  in  actual  computation,  and  an 
upper  bound  is  obtained  for  this  number  which  depends  only  on  the  initial 
interval  chosen.  Now  that  microprogrammed  interval  operations  can  be 
performed  with  speeds  comoarable  to  floating  point  arithmetic,  interval 
iteration  can  be  applied  to  a  wider  class  of  problems  to  obtain  solutions  of 
known  reliability. 

The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC,  and  not  with  the  author  of  this  report. 


A  THEORY  OF  INTERV/'vL  ITERATION 


L.  B.  Rail 


1.  A  fixed  point  problem.  Suppose  that  ((>  is  an  operator  which  maps  a  partially 
ordered  topological  space  S  into  itself.  A  fixed  point  y*  G  S  of  4>  satisfies  the 
equation 

(1.1)  y  =  4>(y); 

solving  this  equation  is  called  the  fixed  point  problem  for  in  S. 

The  partial  ordering  relation  in  S  will  be  denoted,  as  usual,  by  ”s”.  Elements 
Y_t  y  of  S  such  that  ^  y  define  an  interval  Y  =  in  S,  which  is  the  nonempty 

set 

(1.2)  Y  =*  =  iy  I  y:  ^  y  ^  Vf  y  ^  s}.. 

The  elements  y  are  called  respectively  the  lower  and  upper  endpoints  of  Y.  The 
set  of  all  intervals  in  s  is  denoted  by  IS.  The  elements  y  of  S  are  identified  with 
the  corresponding  degenerate  intervals  y  =  [y  ,  yl  which  have  equal  endpoints. 

The  following  assiimptions  will  be  made  concerning  the  topology  of  S: 

(i)  Intervals  are  closed  subsets  of  S; 

(ii)  Each  nondegenerate  interval  contains  a  limit  point  of  countable  order. 
The  last  assumption  means  that  if  Y  is  nondegenerate,  then  it  contains  a  limit 
point  £  such  that  each  neighborhood  of  £  contains  at  least  a  countable  number  of 


and  (11)  ^  is  Inclusion  monotone ,  that  Is 


(2.2)  Y  C  Z  ♦(Y)  C  ♦(Z),  Y,Z  €  IS. 

^  is  called  an  Interval  extension  of  an  Interval  operator  F  If  F(Y)  C  ^(Y)  for 
Y  e  IS  and  (2.2)  holds. 

Definition  2.1.  Given  an  initial  interval  Y^  and  an  interval  operator  the 

sequence  (Y  }  defined  by 
n 

(2.3)  ^  n  -  0,1.2,..,, 

n+x  n  n 

is  said  to  be  generated  by  interval  iteration  starting  from  Y^. 

Note  that,  from  (2.3), 

(2.4)  ^0  ^  ^1  ^  ^2  ^  ' 

hence,  interval  iteration  generates  a  nested  (or  descending)  sequence  of  closed  sets. 
Definition  2.2.  The  interval  Iteration  process  (2.3)  is  said  to  diverge  if 

(2.5)  ^  (empty) 
for  some  positive  integer  N;  otherwise, 

os 

(2.6)  Y*  -  n  Y 

n«0 

is  nonempty  by  the  Cantor  theorem  ([10],  pp.  34*35),  and  the  interval  iteration  is 

said  to  converge  to  the  limit  Y*  *  {Y  }  given  by  (2.6). 

■'  '  '  n-***  n 

Thus,  according  to  this  definition,  convergence  and  divergence  of  interval 
iteration  have  a  converse  relationship,  as  one  would  expect. 

Theorem  2.1.  If  4  is  an  interval  extension  of  the  operator  4  in  S,  and  the 
initial  interval  Y^  contains  a  fixed  point  y*  of  4,  then  the  interval  iteration  (2.3) 
converges ;  furthermore , 

m 

(2.7)  y»  €  y»  -  {Y  )  «  n  y  . 

n-*«  n  *  n 

n»0 

Proof.  This  follows,  as  is  well  known  [3],  [6],  from  (2.3)  and  mathematical 
induction,  since  y*  €  y^^  •  4(y*)  -  y*  €  4(Yj^),  and  thus  y*  €  ■  Yj^n4(Yj^)  ^  0.  QED 

-  2  - 


The  contrapositive  of  Theorem  2,1  is  the  following  result,  which  is  more  in¬ 
cisive  . 

Theorem  2.2.  If  is  an  interval  extension  of  and  the  interval  iteration 
(2.3)  diverges,  then  the  initial  interval  contains  no  fixed  points  y*  c' 

This  assertion  was  noted  by  Nickel  (8)  in  connection  with  an  interval  version 
of  Newton's  method. 

Observe  that  convergence  of  interval  iteration  is  a  necessary,  not  sufficient, 
condition  for  the  existence  of  a  fixed  point  y*  €  of  <});  divergence,  on  the  other 
hand,  is  a  sufficient  condition  for  nonexistence  of  fixed  points  of  ^  in  Y^. 

3.  Comparison  with  ordinary  iteration.  The  ordinary  iteration  method 

(3.1)  "  0,1,2,..., 

is  often  used  to  attemot  to  generate  a  sequence  {y  )  which  converges  to  a  fixed  point 
*■  n 

y*  of  starting  from  some  initial  point  y^.  If  is  continuous  in  the  topology  for 

S,  in  which  also  ^'^{y  }  ==  y*  ^  S,  then  y*  will  be  a  fixed  point  of  A,  and  if  is 
n-^“  Ji  O 

a  closed  subset  of  S  such  that  {y  }  C  y^,  then  y*  €  y  On  the  other  hand,  if  is 

n  0  0  0 

a  subset  of  S  which  does  not  contain  a  fixed  point  of  the  continuous  operator 
theih  the  sequence  generated  by  the  iteration  (3.1)  cannot  converge  to  a  point  of  Y^, 
The  first  alternative  will  be  called  convergence  into  Y^,  and  the  second  divergence 
from  Y^.  On  the  basis  of  these  definitions  cuid  the  corresponding  concepts  for  incer- 
val  iteration  given  in  Definition  2.2,  a  comparison  of  ordinary  and  interval  iteration 
is  shown  in  Figure  3.1. 


Ordinary  Iteration  y  ,  =  '^(y  )  .  I  Interval  Iteration  Y  ,  ®  Y  n  ay  . 


Convergence  (into  Y^)  * 

Existence  (y*  G  Y^) 

Existence  (y*  G  Y^l 

Convergence  (Y  -  n  y  0) 

n»0 

Nonexistence  (y*  ^  Y^)  ^ 

Divergence  ^some  Y  *  0)  i 

^  ( 

Divergence  (from  Y^) 

1  1 

1  Nonexi;.' tence  (y*  ^  Y^) 

Figure  3.1.  Ordinary  and  interval  Iteration  Compared. 


Thus,  interval  iteration  stands  in  a  converse  relationship  to  ordinary  itera¬ 
tion  under  the  above  assumptions.  It  is  worth  noting  that  in  metric  spaces  S,  the 
convergence  of  the  ordinary  iteration  process  (3.1)  often  depends  on  being  able  to 
choose  the  initial  point  y^  "close”  to  the  fixed  point  y*,  and  that  some  operators  ^ 
have  fixed  points  y*  which  repel  the  iteration  sequence  (y^}  for  all  y^  ^  y*.  The 
convergence  of  interval  iteration,  on  the  other  hand,  follows  if  the  initial  interval 
is  "large  enough"  to  contain  a  fixed  point  y*  of 
4.  Applications  of  interval  iteration.  Interval  iteration  may  be  applied  in  sev¬ 
eral  ways  to  the  fixed  point  problem  (1.1) . 

1*.  Suppose  that  the  interval  is  known  to  contain  a  fixed  point  y*  of 
perhaps  on  the  basis  cf  a  nonconstructive  fixed  point  theorem.  In  this  case,  the 
interval  iteration  (2.3)  will  converge,  and  may  be  used  to  obtain  lower  and  upper 
bounds  for  y*,  namely, 

(4.1)  ^  s  y*  S  n  ■  0,1,2,..., 

vrhere  Y  ■  (y_  ,  y  )  ,  and  in  the  limit , 

n  “n  n 

(4.2)  ^  35  y*  i  y*, 

%rhere  Y*  •  (y*  ,  y*]  is  the  limit  (2.6)  of  {Y  }. 

^  n 

The  bounds  (4.1)  give  improved  results  as  long  as  the  inclusions  (2.4)  are 
strict.  However,  if  •  Y^  for  some  positive  integer  N,  then 

•» 

(4.3)  Y*  -  n  Y  -  Y„  ; 

_  n  N 

n«0 

this  is  called  finite  convergence  of  the  interval  iteration  (2.3).  If  finite  con¬ 
vergence  takes  place,  then  the  best  lower  and  upper  bounds  obtaineible  for  y*,  start- 
Ing  from  ,  7g) .  are 

(4.4)  ij  •  S  y*  S  7^  “  7*  • 

2*.  If  it  is  not  known  whether  or  not  Y^  contains  a  fixed  point  y*  of  <^,  in¬ 
terval  iteration  r.ay  still  be  useful  in  one  of  the  following  ways. 


(i)  As  long  as  the  interval  iteration  is  producing  intervals  which  de¬ 
crease  at  each  step  (strict  inclusion  holds  in  (2.4)),  then  an  existence  test  that 
fails  because  Y^,  Y^,  Y^_^  are  "too  large”  may  succeed  for  This  may  then 

be  taken  as  the  initial  interval  Y^,  and  one  has  the  favorable  case  1"*  discussed  above 

(ii)  If  the  iteration  produces  an  empty  intersection  (divergence)  ,  then 
this  establishes  conclusively  that  the  initial  interval  Y^  does  not  contain  a  fixed 
point  y*  of  so  that  this  interval  may  be  excluded  from  further  consideration. 

There  is,  of  course,  a  third  possibility; 

(iii)  The  interval  iteration  (2.3)  leads  only  to  an  interval  Y®  in 
which  no  conclusive  assertion  about  existence  or  nonexistence  of  a  fixed  point  y* 
of  is  available,  (Y®  may  be  the  limit  Y*  if  obtained  in  a  finite  number  of  steps, 
or  otherwise.) 

Possible  alternatives  in  this  situation  include  partition  of  the  resulting  in¬ 
terval  Y®  into  subintervals  for  further  examination,  a  strategy  developed  by  Moore 
and  Jones  (71  ,  or  acc3ptance  of  Y®  as  a  ’’generalized”  or  ”pseudosolution"  (relative 
to  the  initial  interval  Y^)  of  the  fixed  point  problem.  This  latter  choice  may  be 
useful  in  the  development  of  an  interval  version  of  regularization  of  solutions  of 
ill-posed  problems. 

5,  Interval  iteration  on  a  grid.  The  ordinary  iteration  process  (3.1)  is  a  poor 
model  of  what  actually  occurs  in  computation,  since  it  is  usually  impossible  to  car¬ 
ry  out  the  indicated  transformations  exactly.  Interval  iteration,  on  the  other  hand, 
is  readily  adaptable  to  actual  machine  computation,  and  its  theory  can  be  preserved 
intact . 

Suppose  that  G  (called  a  grid)  is  a  finite  subset  of  the  space  S.  Here,  one 
may  think  of  the  set  of  numbers  which  have  exact  representations  on  a  given  computer, 
and  finite  Cartesian  products  of  such  a  set.  The  subset  of  IS  consisting  of  intervals 
with  endpoints  in  G  will  be  denoted  by  IG,  that  is, 

(5.1)  IG  =  { [a  ,  b]  !  a,b  e  G). 

The  union  of  all  intervals  in  IG,  considered  as  subsets  of  S,  defines  a  closed 
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subset  D  of  S,  since  IG  is  a  finite  collection  of  closed  sets  (lO] .  The  operation 


of  directed  rounding  will  now  be  defined  in  ID,  the  set  of  all  intervals  in  S  having 
endpoints  in  D. 

Definition  5.1.  For  x  €  D,  the  upward  rounding  operator  7  to  G  is  defined  by 

(5.2)  7x  -  min  {b  I  b  2  X,  b  e  G)  , 
and  the  downward  rounding  operator  A  to  G  by 

(5.3)  Ax  *  max  (a|a^x,  a€G}. 

For  X  ■  Ix  »  x]  €  ID,  the  directed  rounding  operator  0  to  IG  is  defined  by 

(5.4)  QX  *  0(x  ,  x)  *  (Ax  ,  7x)  ,  X  ■  (3^  r  x)  6  ID. 

It  follows  immediately  from  this  definition  that  □  is  an  inclusion  monotone  in*- 
terval  operator.  Furthermore,  if  maps  D  into  itself  and  4  is  an  interval  extension 
of  then  will  be  an  interval  extension  of  ^  which  maps  IG  into  IG.  Thus,  for 
actual  computation,  it  may  be  assumed  that  the  interval  extension  ^  of  ^  in  (2.3)  has 
been  constructed  to  map  IG  into  itself.  This  means  that  the  transformed  intervals 
♦(Y^)  will  be  exactly  representable  in  terms  of  elements  of  G  for  Y^  €  IG.  The  theory 
of  interval  iteration  given  above  applies  to  operators  of  this  type  without  modifica¬ 
tion.  Furthermore,  tuider  the  following  reasonable  assumption,  the  entire  interval 
iteration  (2.3)  may  be  carried  out  exactly,  using  only  elements  of  the  grid  G. 

Assumption  5.1  (Intersection  Property) .  If  X,Z  €  IG,  then  XnZ  «  0,  the  empty 
set,  or  XnZ  ^  IG. 

Thus,  if  IG  has  the  intersection  property,  and  the  interval  extension  4  of  ^ 
has  been  constructed  to  map  IG  into  itself,  then  the  selection  of  an  initial  inter¬ 
val  Yq  G  IG  will  assure  that  the  intesvals  ^2'  generated  by  the  interval  it¬ 
eration  (2.3)  also  belong  to  IG.  Furthermore,  this  interval  iteration  on  IG  will 
always  converge  or  diverge  in  a  finite  number  of  steps.  To  see  this,  let  G#X  > 

G#  (x  ,  x]  denote  the  number  of  grid  points  (elements  of  G)  contained  in  the  interval 
X  G  IG.  Then,  the  following  result  holds. 
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Theorem  5.1.  On  IG,  the  interval  iteration  (2.3)  will  converge  or  diverge  in 
at  most  G# (Y^)  steps . 

Proof.  If  the  interval  iteration  (2.3)  has  not  terminated  in  n  steps  by  divergence 
or  convergence,  then  it  will  have  generated  distinct  intervals  *  * ’ '  ^ 

including  the  initial  interval  Y^.  Since  (2.4)  holds,  one  has 

(5.5)  G#(Y  )  i  G#(Y  ,)  -  1  ^  G#(Y  ,)  -2  S  . . .  S  G#(Y^)  -  n. 

n  n-i  n~^  0 

Thus,  the  maximum  length  of  a  sequence  of  distinct  nested  intervals  in  IG  is  v  = 

G# (Y^)  -  1,  since  each  interval  in  IG  must  contain  at  least  one  point  of  G.  If  the 

interval  iteration  has  not  terminated  by  the  vth  step,  then 

15.6)  1 

by  (5.5),  which  implies  that  Y^  is  a  degenerate  interval.  Now,  one  has  either  Y^  C 
4(Y^),  in  which  case  (convergence  in  v  steps),  or  Y^n<&(Y^)  =  0  (divergence 

in  V  +  1  »  G# (Y^)  steps) .  QED 

Thus,  in  actual  computation,  convergence  or  divergence  of  an  interval  iteration 
is  an  observable  event  in  principle ,  since  one  works  on  a  grid  of  machine  numbers . 

Of  course,  G#(yQ),  although  finite,  could  be  prohibitively  large;  however,  termination 
of  interval  iteration  is  usually  observed  in  far  fewer  steps.  The  construction  cf 
the  interval  operator  4>  is  crucial  to  the  success  cf  interval  iteration  [3] ,  but  de¬ 
pends  heavily  on  the  nature  of  S,  and  the  grid  G  available. 

6,  Solution  of  equations.  In  many  applications,  S  is  a  linear  space,  and  the  problem 
of  interest  is  to  find  a  solution  x*  of  the  equation 

C6.1)  f(x)  =  0. 

This  may  be  transformed  into  a  fixed  point  problem  (1.1)  in  many  ways  by  the  intro¬ 
duction  of  suitable  iteration  operators  For  example,  one  may  take 
(6.21  (Ji(x)  -  X  -  Yf(x) 

to  define  (>,  where  Y  is  an  invertible  linear  operator  in  S.  Given  an  interval  ex¬ 
tension  F  of  f,  the  corresponding  interval  extension  0  of  is 
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<6. 3) 


4>(X)  =  X  -  YF(X) 


using  interval  arithmetic  [4],  [6],  if  S  is  a  Banach  space,  and  f  has  a  Fr^chet 
derivative  f ,  then 

(6.4)  (>*  (x)  =  I  -  Yf  ’  (x)  , 

where  I  denotes  the  identity  operator,  and  a  more  accurate  interval  extension  of 
can  be  constructed  on  the  basis  of  its  mean -value  form  [1] .  Let  F*  be  an  interval 
extension  of  f*,  then  the  corresponding  interval  extension  of  <|>*  is  given  by 

(6.5)  (X)  »  I  -  YF’ (X) , 
euid  the  mean-value  form  of  (6.2)  is,  for  y  ^  X, 

(6.6)  ^(X)  «  y  -  Yf(y)  +  {l  -  YF*(X)}{X  -  y)  , 

and  this  interval  extension  0  of  0  is  called  the  Krawczyk  iteration  operator.  It 
arose  from  consideration  of  ^Ln  interval  version  of  Newton's  method  (2) ,  and  has  many 
useful  properties  [3],  [5],  [9].  In  actual  practice,  computation  would  be  done  with 
a  rounded  version  of  (6.6).  Suppose  that  F,  F'  are  interval  extensions  in  IG  of  f, 
f,  then 

(6.7)  t(X)  -  □{/  -  VFCy)  +  {I  -  YF’CX)}(X  -  y)  } 

will  have  values  in  13  for  y  €  G,  X  €  IG.  An  even  more  rounded  interval  extension 
of  (6.6)  to  IG  is 

(6.8)  *(X)  =  □(□{y  -  DYFCy)}  +  □(□{!  -  []YF’(X)}-D(X  -  y)  } } , 
which  models  a  realistic  computational  interval  operator. 
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